REMARKS 

In view of the above amendments and the following remarks, reconsideration of the 
rejections and further examination are requested. 

Claims 21-38 are pending in this application. Claims 21-25 and 28-38 stand rejected. 
Claims 21-38 are amended herein. No new matter has been added. 

The Applicants greatly appreciate the Examiner's indication that claims 26 and 27 
contain allowable subject matter and would be allowable if rewritten in independent form 
including all of the limitations of the base claim and the intervening claims. 

The specification and abstract have been carefully reviewed and revised to make 
grammatical and idiomatic improvements in order to aid the Examiner in further consideration of 
the application. A substitute specification and abstract including the revisions have been 
prepared and are submitted herewith. No new matter has been added. Also submitted herewith 
are marked-up copies of the substitute specification and abstract indicating the changes 
incorporated therein. 

Claims 21-25 and 28-38 have been rejected under 35 U.S.C. § 103(a) as being 
unpatentable over Iijima et al. (U.S. Patent No. 6,621,524) (hereinafter referred to as "Iijima") in 
view of Cheiky et al. (U.S. Patent No. 6,919,892) (hereinafter referred to as "Cheiky") and 
further in view of Hamburg (U.S. Patent No. 6,028,583) (hereinafter referred to as "Hamburg"). 
Independent claims 21 and 38 have been now amended to slightly clarify the present invention. 
Thus, the above-mentioned rejections are inapplicable to amended claims 21 and 38 for the 
following reasons. 

Claim 21 is patentable over Iijima because it requires a portable terminal including, in 
part, an image combining section operable to combine a captured image and a background image 
in a plurality of areas designated by mask information, wherein an order of the plurality of areas 
is predetermined to cause each of the plurality of areas to interrelate with one another, and the 
image combining section is further operable to combine the captured image in the plurality of 
areas sequentially according to the predetermined order. 

Iijima discloses an image pickup apparatus for imaging a subject and an image processing 
method. Specifically, Iijima discloses cut-out image production/registration means 123 for 

- 8 - 



cutting out a desired part in a through image by using a desired mask pattern registered in a mask 
pattern memory 14B. Moreover, a user specifies and selects a desired one among mask patterns 
displayed on a screen. When a desired part of a recorded image is cut-out by using a selected 
mask pattern, the mask pattern and the recorded image are combined (by recorded image 
production means 124) on the screen to be displayed on a liquid crystal display in order to 
position them thereon. It is possible for the user to move the displayed cut-out image so that the 
cut-out image is superposed on the desired part of the reproduced image serving as a background. 

In contrast to the present invention, Iijima does not disclose the means 123 and 124 using 
a predetermined order of a plurality of areas for causing each of the plurality of areas to 
interrelate with one another, and combining the recorded image in the plurality of areas 
sequentially according to the predetermined order. Instead, Iijima discloses masks having a 
single cut-out area used to frame a single image, and superimposing the combination on a 
through image. Moreover, there is no suggestion or disclosure in Iijima to modify the means 123 
and 124 to use a mask having a plurality of cut-out areas and sequentially combining them with 
recorded images in a predetermined order. In other words, Iijima does not disclose an image 
combining section operable to combine a captured image and a background image in a plurality 
of areas designated by mask information, wherein an order of the plurality of areas is 
predetermined to cause each of the plurality of areas to interrelate with one another, and the 
image combining section is further operable to combine the captured image in the plurality of 
areas sequentially according to the predetermined order. 

For at least the reasons set forth above, it is believed clear that Iijima fails to disclose or 
suggest the present invention as recited in amended claim 21 . 

Regarding the combination of Iijima, Cheiky and Hamburg, Cheiky is relied upon in the 
rejection as disclosing the masking of multiple regions and the synthesis of multiple regions to a 
background image. Specifically, Cheiky discloses the construction of photo realistic talking 
heads. However, it is clear that Cheiky also fails to disclose the above-discussed features of the 
television receiver recited in amended claim 21. 

Hamburg is relied upon in the rejection as disclosing that the creation "of a composite 
image is a processing of combining the images (layers), and defining the order of combining 
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layers (images)." Additionally, Hamburg is relied upon as disclosing that a user may wish to 
group (combine) layers (images) together to work with each group as a single entity. 
Specifically, Hamburg discloses a method of compositing a set of ordered image layers in which 
a compound layer contains a plurality of image layers. Image layers 52 include an image 54, an 
optional image layer mask or masks 56, and image layer compositing controls 58, such as a 
global opacity 58a, a color blending effect, such as a transfer mode 58b, and a transparency 
treatment 58c. The mask or masks 56 provide opacity information as a function of position. 
Image layers are composited in order from bottom to top. Specifically, beginning with the 
bottom layer, the system determines whether the current image layer is part of a compound layer. 
If the image layer is a normal layer, it is composited in a conventional fashion into the primary 
accumulation buffer. 

Notably, Hamburg does not disclose a predetermined order of areas. Instead, Hamburg 
discloses an order of layers such that the layers are composited with each other to form a single 
final image. Moreover, there is no suggestion or disclosure to modify the method of Hamburg to 
generate a final image using an order of areas. In other words, Hamburg does not disclose an 
image combining section operable to combine a captured image and a background image in a 
plurality of areas designated by mask information, wherein an order o f the plurality of areas is 
predetermined to cause each of the plurality of areas to interrelate with one another , and the 
image combining section is further operable to combine the captured image in the plurality of 
areas sequentially according to the predetermined order . Thus, it is clear that Hamburg also fails 
to disclose the above-discussed features of the portable terminal recited in amended claim 21 . 

Regarding claim 38, it is patentable over the references relied upon in the rejection for 
reasons similar to those set forth above in support of claim 21 . That is, claim 38 requires a 
method for processing, including, in part, combining a captured image and a background image 
in a plurality of areas designated by mask information, wherein an order of the plurality of areas 
is predetermined to cause each of the plurality of areas to interrelate with one another , and 
combining the captured image and the background image comprises combining the captured 
image in the plurality of areas sequentially according to the predetermined order . These features 
are not disclosed or suggested by the references. 
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Because of the above-mentioned distinctions, it is believed clear that claims 21 and 38 are 
patentable over the references relied upon in the rejection. Further, it is submitted that there is no 
reason in the prior art of record that would have caused an ordinary artisan to modify the applied 
art in such a manner as to result in, or otherwise render obvious, the invention of claims 21 and 
38. Therefore, it is respectively submitted that claim 21, and claims 22-37 depending therefrom, 
and claim 38 are clearly allowable over the prior art of record. 

In view of the foregoing amendments and remarks, all of the claims now active in this 
application are believed to be in condition for allowance. Reconsideration and favorable action 
are respectfully solicited. 

Should the Examiner believe there are any remaining issues that must be resolved before 
this application can be passed to issue, it is respectfully requested that the Examiner contact the 
undersigned by telephone in order to resolve such issues. 



KM/NEP/km 

Washington, D.C. 20006-1021 
Telephone (202) 721-8200 
Facsimile (202) 721-8250 
December 28, 2007 



Respectfully submitted, 



Kiyoshi OHGISHI et al. 




Kevin McDermott 
Registration No. 48,1 13 
Attorney for Applicant 
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CROSS-REFERENCE TO RELATED APPLICATIONS 

This application is the National Stage of International 

Application No. PCT/ JP03/13455, filed on October 22, 2003. 

10 TECHNICAL FIELD BACKGROUND OF THE INVENTION 
1. Field of the Invention 

The present invention relates to a portable terminal that 
can combine images. More specifically, the present invention 
relates to a portable terminal that combines an image for background 

1 5 and a captured image and a method for combining images used therefor . 

BACKGROUND ART 2 . Description of the Related Art 

Conventionally, as a terminal device including a camera 
function that acquires and captures real-time image data from the 

20 outside, there has been a terminal device that combines recorded 
images that have been previously stored in the terminal device 
and real-time captured images that are input from a camera when 
capturing images with the camera (e.g., see Japanese Laid-Open 
Patent Publication No. 2001-177764, hereinafter, referred to as 

25 " Patent document 1") . FIG. 12 is a block diagram showing a 
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configuration of a conventional image combining device disclosed 
in Patent document 1 . 

In FIG. 12, the conventional image combining device includes 
an uncombined image recording portion 100, an image selecting 
5 portion 101, a coordinate input portion 110, a camera portion 120, 
an image combining portion 130, a display portion 140, a recording 
instructing portion 150, and a combined image recording portion 151 . 
The coordinate input portion 110 is a hand-writing input portion 
(pen input portion) with which any area on the screen can be 

10 designated. 

To the image combining portion 130, image data selected by 
the image selecting portion 101 from a plurality of image data 
sets that are previously stored in the uncombined image recording 
portion 100, information regarding the area defined by the shape, 

15 the size and the position designated by a user with pen input in 
the coordinate input portion 110, and real-time image data output 
from the camera portion 120 are input. 

The image combining portion 130 combines images by 
superimposing the real-time captured image from the camera 

20 portion 120 on the image selected by the image selecting 
portion 101 in an area shown by the information from the coordinate 
input portion 110. The image combining portion 130 lets the 
combined images displayed on the display portion 140 . Furthermore, 
in response to an instruction from the recording instructing 

25 portion 150, the image combining portion 130 stores the image that 



is displayed at the moment when instructed in the combined image 
recording portion 151. With such processing, the conventional 
image combining device can combine a real-time captured image with 
a recorded image that is previously stored in the device in an 
5 area that is designated by the user. 

The conventional image combining device requires the 
coordinate input portion (for example, hand- writing written input 
portion or pen input portion) for designating an arbitrary area 
on the display screen io necessary in order to incorporate a combined 

10 image into a previously prepared image. However, it is more 
difficult to provide a hand- writing written input portion or the 
like in a terminal device having a low hardware performance (e.g., 
mobile telephones, digital still cameras, PDAs, information 
household electrical appliances, watches, television telephones, 

15 television, etc.) than the conventional combining device, a 
personal computer and the like . Therefore, in these devices , there 
is no other way than using simple keys or buttons in order to 
designate an area on the screen. However, the operability of the 
key operation and the button operation to designate an area on 

20 the screen is significantly poor. 

Therefore, the object of the present invention is to provide 
a portable terminal that can combine a plurality of captured images 
easily by simple operation with keys and buttons, and a method 
for combining images used therefor. 

25 
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DISCLOSURE BRIEF SUMMARY OF THE INVENTION 

To achieve the above objects, the present invention has the 
following aspects . 

A first aspect of the present invention is directed to a 
5 portable terminal that combines a background image for a background 
and a captured image that is captured, comprising background image 
acquiring section operable to acquire the background image; 
captured image acquiring section operable to acquire the captured 
image; mask information acquiring section operable to acquire mask 
10 information in which at least one area for combining the captured 
image is designated, in response to an instruction of a user; and 
image combining section operable to combine the captured image 
acquired by the captured image acquiring section and the background 
image acquired by the background image acquiring section in the 
15 area designated by the mask information acquired by the mask 
information acquiring section . 

Preferably, a plurality of the areas are designated in the 
mask information, and an order is designated in the plurality of 
areas, and the image combining section combines the captured image 
20 in the areas sequentially according to the order. 

Furthermore , the image combining sectionmay change the order 
of the areas in which the captured image is to be combined, in 
response to an instruction of a user. 

Preferable Preferably , the portable terminal further 
25 comprises a background image creating section operable to create 



the background image by displaying a captured image acquired by 
the captured image acquiring section as a moving image while 
displaying an area designated by the mask information acquired 
by the mask information acquiring section, and entering the 
5 captured image . 

More preferably, the background image creating section links 
the created background image with the mask information that has 
been used when creating the background image, and when the 
background image is linked with mask information, the mask 
10 information acquiring section acquires the linked mask 
information . 

Furthermore, the portable terminal further comprises an 
intermediate information creating section operable to generate 
information showing a halfway state in image-combining by the image 
15 combining section, and intermediate information transmitting 
section operable to transmit the intermediate information created 
by the intermediate information generating section to an external 
device . 

Preferably, the intermediate information creating section 
20 creates the intermediate information such that the intermediate 
information includes unused area information showing an area in 
which a captured image is not yet combined. 

Furthermore, preferably, when the intermediate information 
is transmitted from an external device, which is not in its own 
25 terminal, then the image combining section combines a captured 



image acquired by the captured image acquiring section in an area 
designated by the unused area information included in the 
intermediate information . 

Preferably, the image combining section combines the 
5 captured image acquired by the captured image acquiring section 
such that the captured image is displayed as a moving image in 
the area. 

More preferably, in response to an instruction of a user, 
the image combining section enters the captured image displayed 

10 as a moving image and combines the background image and the captured 
image that is determined. 

Preferably, the background image is linked with the mask 
information, and the mask information acquiring section acquires 
mask information that is linked with the background image. 

15 Preferably, when in the mask information, a plurality of 

the areas are designated, the image combining section selects the 
area for combining the captured image in response to an instruction 
of a user, and combines the captured image and the background image 
sequentially . 

20 Preferably, the portable terminal further comprises a 

background image storing portion operable to store at least one 
of the background images, wherein the background image acquiring 
section acquires the background image from the background image 
storing portion. 

25 Preferably, the portable terminal further comprises a camera 



portion operable to capture an image, wherein the background image 
acquiring section acquires an image captured by the camera portion 
as the background image. 

Preferably, the portable terminal further comprises a 
5 communication portion operable to communicate with an external 
device, wherein the background image acquiring section acquires 
the background image from an external device via the communication 
portion. 

Preferably, the portable terminal further comprises a camera 
10 portion operable to capture an image, wherein the captured image 
acquiring section acquires an image captured by the camera portion 
as the captured image . 

Preferably, the portable terminal further comprises a 
communication portion operable to communicate with an external 
15 device, wherein the captured image acquiring section acquires the 
captured image from an external device via the communication 
portion. 

Preferably, the portable terminal further comprises a mask 
information storing portion operable to store at least one of the 
20 mask information images, wherein the mask information acquiring 
section acquires the mask information from the mask information 
storing portion. 

Preferably, the portable terminal further comprises a 
communication portion operable to communicate with an external 
25 device, wherein the mask information acquiring section acquires 



the mask information from an external device via the communication 
portion. 

A second aspect of the present invention is directed to a 
method for processing a portable terminal that combines a 
5 background image for a background and a captured image that is 
captured, comprising a step of acquiring the background image; 
a step of acquiring the captured image; a step of acquiring mask 
information in which at least one area for combining the captured 
image is designated in response to an instruction of a user; and 

10 a step of combining the captured image and the background image 
that are acquired in the area designated by the mask information 
that is acquired. 

According to the present invention, the following advantages 
can be provided. The portable terminal of the present invention 

15 can designate an area in which a captured image is desired to be 
combined simply by acquiring mask information defining the area 
in which the captured image is desired to be combined in response 
to an instruction of the user, and a plurality of images can be 
combined easily with simple operation with keys and buttons. 

20 Therefore, a plurality of images can be combined easily, so that 
an area (shape, size, position and the like) in which a captured 
image is desired to be combined can be determined by easy operation 
(e.g., key operation or button operation) even with a portable 
terminal that has difficulty in designating an arbitrary position 

25 on the screen such as mobile telephones or digital still cameras. 
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Thus, a simpler user interface can be provided in which the 
operability is improved and the number of input operations of the 
user is reduced. 

Furthermore, since the order of the areas in which a captured 
5 image is to be combined is previously determined and captured images 
are combined automatically in that order, the user can combine 
images in a simpler manner. 

The order of the areas is changed by the user, so that it 
is possible to combine images as desired by the user. The order 
10 of the areas also can be changed by simple input means such as 
button switches . 

The background image creating means is provided, so that 
it is possible to display an image superimposed on only a mask 
frame at the time of capturing an image, and it is possible to 
15 photograph a background image while confirming the area position 
when a mask is used. Thus, it is possible to create a background 
image that agrees with what is in the user's mind. 

The captured image created by the background image creating 
means is linked with the mask information, so that mask information 
20 acquiringmeans automatically acquires the linkedmask information . 
Therefore, when the user creates a recorded image that agrees with 
what is in the user's mind, it is not necessary to select the mask 
information again. 

The intermediate information is transmitted to an external 
25 device, so that the external device can process an image that is 



being combined. 

The intermediate information includes unused area 

information, so that the external device can combine a captured 

image anew in an area in which no captured image is combined. 
5 On the other hand, the portable terminal receives the 

intermediate information, so that a captured image can be combined 

in an area to which no captured image is attached. Thus, an image 

in which a face-photo portrait, scenery or the like is combined 

can be created and exchanged even among people in remote places 
10 by exchanging the intermediate information among a plurality of 

portable terminals . 

Since image combining means lets an captured image displayed 

as a moving image in the area, the user can combine images while 

confirming the captured image. 
15 The user can instruct to combine images by entering the image 

that is displayed as a moving image, and therefore images can be 

combined simply by pressing a shutter. 

Furthermore, when the background image is linked with the 

mask information, the mask information is automatically selected. 
20 Therefore, this saves labor for the user to select the mask 

information . 

When a plurality of areas are designated by the mask 
information, the order of the areas is selected by the user, which 
makes it possible to combine images as desired by the user. The 
25 selection of the order of the areas can be also realized by simple 

10 



input means such as button switches. 

The background image is previously stored, so that it is 
possible to combine images only with a portable terminal. 
Furthermore, the background image is acquired from the camera 
5 portion, so that it is possible to create a background image as 
desired by the user . Furthermore, the background image is acquired 
by communications, so that diverse background images can be 
acquired. 

The captured image is acquired from the camera portion, so 
10 that it is possible to combine it with a background image simply 
by using a portable terminal including a camera therein or 
externally provided with a camera. Furthermore, the captured 
image is acquired by communications, so that it is possible to 
combine images by using an image, for example, from a person in 
15 a remote place. 

The mask information is previously stored, so that it is 
possible to combine images only with a portable terminal. 
Furthermore, the mask information is acquired by communications, 
so that diverse mask information can be acquired. 

20 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram showing the configuration of an 
image combining portable terminal according to a first embodiment 
of the present invention; 
25 FIG. 2 is a diagram showing an example of mask information; 
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FIG. 3A is a diagram for illustrating the operation of the 
image combining portable terminal according to the first 
embodiment; 

FIG. 3B is a diagram for illustrating the operation of the 
5 image combining portable terminal according to the first 
embodiment; 

FIG. 3C is a diagram for illustrating the operation of the 
image combining portable terminal according to the first 
embodiment; 

10 FIG. 3D is a diagram for illustrating the operation of the 

image combining portable terminal according to the first 
embodiment; 

FIG. 3E is a diagram for illustrating the operation of the 
image combining portable terminal according to the first 
15 embodiment; 

FIG. 4 is a flowchart showing the operation of the image 
combining portable terminal according to the first embodiment; 

FIG. 5 is a block diagram showing the configuration of an 
image combining portable terminal according to a second embodiment 
20 of the present invention; 

FIG. 6A is a diagram for illustrating the operation of the 
image combining portable terminal according to the second 
embodiment; 

FIG. 6B is a diagram for illustrating the operation of the 
25 image combining portable terminal according to the second 
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embodiment; 

FIG. 6C is a diagram for illustrating the operation of the 
image combining portable terminal according to the second 
embodiment; 

5 FIG. 7 is a flowchart showing the operation of the image 

combining portable terminal according to the second embodiment; 

FIG. 8 is a flowchart showing the operation of the image 
combining portable terminal according to a third embodiment; 

FIG. 9 is a flowchart showing the operation of a first image 
10 combining portable terminal according to a fourth embodiment; 

FIG. 10 is a flowchart showing the operation of a second 
image combining portable terminal according to the fourth 
embodiment; 

FIG. 11A is a diagram for specifically illustrating the 
15 operations of the first and the second image combining portable 
terminals according to the fourth embodiment; 

FIG. 11B is a diagram for specifically illustrating the 
operations of the first and the second image combining portable 
terminals according to the fourth embodiment; and 
20 FIG. 12 is a block diagram showing the configuration of a 

conventional image combining portable terminal disclosed in Patent 
document 1 . 



BEST MODE FOR CARRYING OUT DETAILED DESCRIPTION OF THE INVENTION 
25 (First Embodiment) 
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FIG. 1 is a block diagram showing the configuration of an 
image combining portable terminal according to a first embodiment 
of the present invention. The image combining portable terminal 
is a device for receiving an input from a user with keys or buttons 
5 and can be, for example, a mobile telephone, a digital still camera, 
a PDA, an information household electrical appliance, a watch, 
a television telephone, television or the like. 

In FIG. 1, the image combining portable terminal includes 
an uncombined image recording portion 200, a background image 

10 acquiring portion 201, a mask recording portion 210, a mask 
information acquiring portion 211, a camera portion 220 , a captured 
image acquiring portion 221, an image combining portion 230, a 
display portion 240, a recording instructing portion 250, and a 
combined image recording portion 2 51. 

15 In the uncombined image recording portion 200, a plurality 

of images, graphics, texts and the like are recorded. The images 
stored in the uncombined image recording portion 200 are referred 
to as "recorded images''. The "recorded images" include not only 
photographed images, but also graphics and texts. The recorded 

20 image data includes data that is previously stored in the device, 
data that has been acquired by communications and stored in the 
device, data that has been input from an external connection 
terminal provided in the device, data that is stored in a memory 
card, and data that is stored in the combined image recording 

25 portion 251 . In addition to the above-described recorded images, 
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the uncombined image recording portion 2 00 may contain additional 
information to be used at the time of combining images, such as 
vertical or horizontal shift, transparency, the number of colors, 
camera exposure, distorting an image, transforming an image, 
5 inverting the brightness of an image or the like. Furthermore, 
two or more images that are linked to each other or data captured 
by a camera may be stored. 

The background image acquiring portion 201 selects specific 
data from the recorded image data stored in the uncombined image 

10 recording portion 200, and inputs the selected data to the image 
combining portion 230. The recorded image selected by the 
background image acquiring portion 201 is used as an image for 
background in the image combining portion 230. Therefore, 
hereinafter, the recorded image that is acquired by the background 

15 image acquiring portion 201 is referred to as "background image". 
For selection of an image in the background image acquiring 
portion 201, keys or buttons (not shown) provided in an image 
combining portable terminal are used. The background image 
acquiring portion 2 01 simply selects a previously registered image, 

20 so that a desired image can be selected easily only by key or button 
operation. 

The mask recording portion 210 stores a plurality of sets 
of mask information. Here, "mask information" refers to 
information that defines an area where an image from the camera 
25 portion 220 is to be combined with the data selected by the background 

15 



image acquiring portion 201. The mask information is defined by 
at least one mask area. The "mask area" refers to information 
showing the area for combining a captured image by the camera 
portion 220 such as the shape, the size, and the position on the 
5 screen. The mask information stored in the mask recording 
portion 210 includes data that has been acquired by communications 
and stored in the device, data that has been input from an external 
connection terminal provided in the device, and data that is stored 
in a memory card. Thus, the mask information is downloaded using 

10 communications or acquired from a memory card, so that the mask 
information that the user desires can be updated or added freely. 
In order to acquire the mask information from an external device 
in the manner as described above, a modem or an external input 
terminal, or a communication portion such as infrared port is 

15 necessary to be provided in the image combining portable terminal . 
The mask area may include additional information such as the 
transparency, the number of colors, distorting an image, 
transforming an image, inverting the brightness of an image, using 
the color of the image for a specific color in the camera image 

20 such as blue matte process. 

FIG. 2 is a diagram showing an example of themask information. 
As shown in FIG. 2, items of the mask information are an item "area 
number", an item "shape", an item "size", and an item "position". 
In the item "area number", the number of the mask area that is 

25 defined by the item "shape" and the following items is shown. The 



area number shows the order to the mask area. The image combining 
portion 230 combines an image captured by the camera portion 220 
in the ascending order of the area number. In the item "shape", 
the planar shape of the mask area is shown. In the item "size", 
5 the size of the planar shape shown in the item "shape" is shown. 
In the item "position", the position on the screen is shown of 
the planar shape that is specified by the items "shape" and "size" . 
As shown in FIG. 2 (as in the case of area number 2), the items 
"size" and "position" may be shown in combination. The size and 

10 the position can be shown by the number of dots, the percentage 
with respect to the image, or any other information that can specify 
the size and the position for combining images . In the example 
of FIG. 2, the mask areas do not overlap each other, but the mask 
areas may be adjacent to each other or may overlap each other. 

15 In the case where they overlap each other, it is necessary to add 
information that specifies image data that should be used. 
Furthermore, information as to whether image data is used for every 
dot or whether the first camera image is to be used may be registered 
without designating a mask area with a planar shape as in this 

20 example. 

In response to an instruction from the user, the mask 
information acquiring portion 211 selects desired mask information 
from the mask information stored in the mask recording portion 210 
and inputs it to the image combining portion 230. For selection 
25 of mask information in the mask information acquiring portion 211, 
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keys or buttons (not shown) provided in the image combining portable 
terminal are used. Since mask information that is previously 
registered is merely selected in the mask information acquiring 
portion 211, a layout of a desired captured image combining area 
5 can be selected only with key or button operation. As shown in 
FIG. 2, the mask information is information regarding the mask 
area that is difficult to visually understand, so that the mask 
information acquiring portion 211 lets an image corresponding to 
the mask information displayed on the display portion 240 so that 

10 a user can select mask information (in FIG. 1, an arrow from the 
mask information acquiring portion 211 to the display portion 240 
is omitted) . When inputting the mask information to the image 
combining portion 230, the mask information acquiring portion 211 
may add processing such as left and right inversion, up and down 

15 inversion, rotation, and transformation of the mask area with 
respect to the screen. 

The camera portion 220 is a solid-state imaging device such 
as CCD and CMOS sensors, and externally captures images and 
sequentially outputs real-time captured images. The captured 

20 image acquiring portion 221 acquires aft-a_captured image from the 
camera portion 220 and inputs it to the image combining portion 230 . 
Since the captured image acquiring portion 221 inputs afl-a_captured 
image to the image combining portion 230 regularly (e.g., at an 
interval of every one second) , real-time captured images in 

25 accordance with the position of the camera are input to the image 
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combining portion 230. 

The image combining portion 230 receives an image from the 
background image acquiring portion 201, mask information from the 
mask information acquiring portion 211 and a real-time image from 
5 the captured image acquiring portion 221 as input, and attaches 
the captured image from the captured image acquiring portion 221 
to the image from the background image acquiring portion 201 in 
a region (area) designated by the mask information and displays 
it on the display portion 240. When being instructed to record 
10 the combined image from the recording instructing portion 250, 
the image combining portion 2 30 fixes the captured image from the 
captured image acquiring portion 221 and stores the combined image 
at the point of the instruction to the combined image recording 
portion 251. 

15 The display portion 240 displays the image for display 

obtained from the image combining portion 230 in the real-time 
manner. In this case, the display portion 240 may display in such 
a manner that the left and the right of the image is inverted, 
depending on the positional relationship between the camera 

20 portion 220 and the display portion 240. For example, when the 
camera portion 220 and the display portion 240 are positioned in 
such a relationship that one is on the front face of the device 
and the other is on the back face of the device, the display 
portion 240 displays an image obtained from the image combining 

25 portion 230 in real-time as it is. On the other hand, when the 
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camera portion 220 and the display portion 240 are arranged in 
the same face, the display portion 240 may display an image obtained 
from the image combining portion 230 in real-time as it is, or 
may display an image obtained from the camera portion 220 with 
5 left and right inverted, as if the image is reflected in a mirror. 

The recording instructing portion 250 receives an 
instruction of a user, serves as a shutter that enters a real-time 
image (moving image output from the camera portion 220) output 
from the camera portion 220, and instructs the image combining 

10 portion 230 to record the combined image displayed to the combined 
image recording portion 251. The instruction in the recording 
instructing portion 250 is performed by pressing keys or buttons 
(not shown) provided in the image combining portable terminal or 
starting a self-timer (not shown) or the like. 

15 The combined image recording portion 251 stores an image 

sent from the image combining portion 230 in a memory such as ROM 
or RAM in the device, stores it in an outside storage by 
communications, outputs it from an external connection terminal 
provided in the device, or stores it in a memory card. The combined 

20 image recording portion 251 and the uncombined image recording 
portion 200 are not necessarily different components, but may be 
the same component. The uncombined image recording portion 2 00, 
the mask recording portion 210, and the combined image recording 
portion 251 can be realized by a common memory from the hardware 

25 viewpoint. 



•1 ♦ 

FIG. 3 is a diagram for illustrating the operation of the 
image combining portable terminal according to a first embodiment . 
FIG. 4 is a flowchart showing the operation of the image combining 
portable terminal of the first embodiment. Hereinafter, the 
5 operation of the image combining portable terminal will be 
described with reference to FIGS. 3 and 4. 

First, the background image acquiring portion 201 selects 
a background image that is desired by the user from a plurality 
of recorded images that are stored in the uncombined image recording 

10 portion 200, and inputs it to the image combining portion 230 
(step S301) . For example, it is assumed that the background image 
acquiring portion 201 selects a background image shown in FIG. 3A. 
The selection may be performed by a user while displaying a list 
of information such as names of a plurality of recorded images 

15 that are stored in the uncombined image recording portion 200, 
displaying the recorded images sequentially on the screen, or 
displaying a plurality of recorded images at one time on the screen 
so that one is selected among them. 

Next, the mask information acquiring portion 211 selects 

20 mask information that is desired by the user from a plurality of 
sets of mask information and inputs it to the image combining 
portion 230 (stepS302). For example, it is assumed that the mask 
information acquiring portion 211 selects mask information as shown 
in FIG. 3B. In this case, the mask area includes an elliptical 

25 mask area 11 of area number 1 and a triangular mask area 12 of 



area number 2. As shown in FIG. 2, the mask information is 
abstractly expressed, so that when selecting mask information, 
the mask information acquiring portion 211 lets the user select 
mask information with an image as shown in FIG. 3B displayed or 
5 an image as shown in FIG. 3C displayed in which a background image 
and a mask image are combined . The mask area 11 and the mask area 12 
are entirely represented with white and a portion excluding them 
is made up of transparent images. 

Next, the image combining portion 2 30 is set the area number 

10 for processing to "1" (step S303) . 

Next, the image combining portion 230 attaches an image (see 
FIG. 3B) corresponding to the selected mask information to a 
background image (see FIG. 3A) selected in step S301 (see FIG. 3C) , 
and incorporates a real-time image from the captured image 

15 acquiring portion 221 into the mask area of the area number for 
current processing and lets it dioplayod displays it on the display 
portion 240 (step S304) . In this case, an example of the image 
displayed on the display portion 240 is shown in FIG. 3D. At the 
start of the operation, the area number is "1". Therefore, in 

20 FIG. 3D, in the mask area 12 of area number "2", no image from 
the camera portion 220 is incorporated. As shown in FIG. 3D, the 
unprocessed mask area 12 is made up of a white image . In the stage 
of step S304, when the camera portion 220 is moved, a captured 
image is sent regularly from the camera portion 220, so that the 

25 video image in the mask area for current processing is changed 
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with it. That is to say, the image combining portion 230 displays 
moving images that are captured by the camera portion 22 0 in the 
mask area for current processing. 

In the example of FIG. 3, in step S304 for the first time, 
5 the image combining portion 230 superimposes the image of FIG. 3A 
on the mask of FIG. 3B to generate an image as shown in FIG. 3C, 
and displays a real-time image from the camera portion 220 in the 
elliptical mask area 11 of FIG. 3D. In step S304 for the second 
time, the image combining portion 230 displays the captured image 

10 from the camera portion 220 in the elliptical mask area 11 and 
displays a real-time image from the camera portion 220 in the 
triangular mask area 12 as shown in FIG. 3E . 

The unprocessed mask area is not necessarily filled up with 
white, but, for example, can be filled up with another color such 

15 as black or filled up with a specific pattern, or other methods 
can be used, as long as they can indicate that the area is an 
unprocessed mask area. Furthermore, the image combining 
portion 230 not only generates an image for display by 
superimposing two images, that is, an image selected in step S301 

20 and a captured image, but also may perform a process in which after 
a conversion process is performed by combining an image selected 
in step S301 and a captured image into one image, the converted 
image and captured images are displayed. 

Next, the image combining portion 230 enters an image from 

25 the camera portion 220 that is input in real-time in response to 



a shutter instruction from the recording instructing portion 250 
to enter a combined image (step S305) . At this time, the image 
combining portion 230 stores temporarily an intermediate image 
in which a captured image attached to the mask area is combined 
5 with a background image . The image combining portion 230 may store 
temporarily the intermediate image by linking the area to which 
a captured image is to be attached, the captured image and a 
background image without actually combining these images. After 
input entering, when the user requests a cancel, the image combining 

10 portion 230 erases the latest image that is created in the mask 
area, and displays a real-time image in the mask area again, so 
that images can be captured again. This is a known process and 
can be realized by an image combining portable terminal storing 
processed images and pre-process images 

15 Next, the image combining portion .230 compares the area 

number in the mask information selected in step S302 and the area 
number for current processing to determine whether or not there 
is a remaining mask area (step S306) . When there is a remaining 
mask area, the image combining portion 230 determines whether or 

20 not an instruction to interrupt the image combining process is 
supplied (stepS307) . When there io no an instruction to interrupt 
is not supplied, the area number for processing is incremented 
by one (step S308) , and the procedure returns to the operation 
of step S304. On the other hand, when it is determined in the 

25 operation of step S307 that an instruction to interrupt is supplied, 
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the image combining portion 230 proceeds to the operation of 
step S309. Thus, the captured image from the camera portion 220 
acquired by the captured image acquiring portion 221 is combined 
in the order designated by the area number. 
5 On the other hand, when it is determined in the operation 

of step S30 6 that there is no remaining mask area, the image combining 
portion 230 proceeds to the operation of step S309. In the 
operation of step S309, the image combining portion 230 converts 
combined images for display that are displayed at the moment into 

10 one image and thus generates a final combined image. When the 
procedure goes to the operation of step S309 as a result of 
determining that an instruction to interrupt is supplied in the 
step S307, the image combining portion 230 converts the mask area 
to which no captured image is attached into one image by filling 

15 up the mask area with white or black, or a specific pattern, or 
other methods. This filling-up process is performed in the 
predetermined method. 

When the procedure goes to the operation of step S309 as 
a result of determining that an instruction to interrupt is supplied 

20 in the step S307, the image combining portion 230 may create 
intermediate information showing the halfway state in 
image-combining and may resume the image-combining process later 
in another way than converting the mask area to which no captured 
image is attached into one image by coloring the entire mask area 

25 with white or black, or a specific pattern and storing the converted 



image in the combined image recording portion 251. Here, the 
intermediate information includes an intermediate image that is 
generated in the image combining portable terminal, information 
regarding masks that have been used, unused area information 
5 showing the area number of a mask area in which a captured image 
is not yet combined. The intermediate information may include 
a plurality of images necessary to reproduce the intermediate image, 
mask information, and steps for image-combining that have been 
performed before that point of time. 

10 Thereafter, the image combining portion 230 stores the 

combined image in the combined image recording portion 251 
(step S310) in response to an instruction from the recording 
instructing portion 250 and ends the process. 

Thus, in the image combining portable terminal according 

15 to the first embodiment, themaskinformationacquiringportion 211 
selects mask information that is previously registered and 
determines the area in which a captured image from the camera 
portion 220 is desired to be combined in the order designated by 
the mask information. According to this order, the image combining 

20 portion 230 combines pre-combined images and captured images . The 
mask information acquiring portion 211 merely selects mask 
information, so that even with a device provided with a limited 
number of keys such as a mobile telephone, the area for combining 
can be easily determined. Therefore, it is possible to provide 

25 an image combining portable terminal that can determine the area 
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defined by the shape, the size or the position for a combined image 
by easy operation with simple keys or buttons to combine a plurality 
of images easily. 

In the first embodiment, the image combining portion 230 
5 attaches captured images acquired by the captured image acquiring 
portion 221 in the mask areas sequentially in the order of the 
area number designated by the mask information . However, the order 
of the mask area in which a captured image is attached can be changed 
in accordance with the instruction of the user . More specifically, 

10 in step S303 in FIG. 4, the image combining portion 230 lets the 
user designate whether or not the order of the mask areas for 
attachment of a captured image is desired to be changed. When 
it is designated to change the order, the user selects a mask area . 
Then, in step S304, the image combining portion 230 generates an 

15 image for display in which a captured image is attached in a selected 
mask area. Then, in step S308 in FIG. 4, the image combining 
portion 230 lets the user select a remainingmask area and continues 
to attach captured images . Thus, letting the user select the order 
of the mask areas for attachment can be performed only with button 

20 operation, so that this can be realized even with a portable 
terminal . 

The area number does not have to be previously assigned to 
the mask information. In this case, the image combining 
portion 230 combines images by letting the user designate the mask 
25 area to which a captured image is to be attached without letting 
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the user designate a change of the order. 

In the first embodiment, a captured image is attached to 
a mask area for combining images . However, images can be combined 
in such a manner that the entire or a portion of a captured image 
5 is transparent, or can be combined in such a manner that the 
resolution, the tone or the aspect ratio, etc. of the captured 
image can be changed. Thus, the method for combining a captured 
image in a mask area is not limited to the above. 

In the first embodiment, the image combining portion 230 

10 uses a background image that is stored in the uncombined image 
recording portion 200. However, the captured image acquired by 
the captured image acquiring portion 221 can be used as a background 
image. Furthermore, when a communication portion is provided in 
the image combining portable terminal, the image combining portion 

15 230 may acquire a background image from an external device such 
as servers, other portable terminals, personal computers , digital 
still cameras, or monitor cameras via the communication portion. 

The camera portion 220 may be included inside the image 
combining portable terminal or may be provided outside. 

2 0 When a communication portion is provided in the image 

combining portable terminal, the captured image acquiring 
portion 221 may acquire a captured image from an external device 
such as servers, other portable terminals, personal computers, 
digital still cameras, or monitor cameras, utilizing electronic 

25 mail or the like, via the communication portion. The mask 
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information acquiring portion 211 may acquire mask information 
from an external device, utilizing electronic mail or the like. 
The background image acquiring portion 201 also may acquire a 
background image from an external device, utilizing electronic 
5 mail or the like. 

The background image acquiring portion 201 may acquire an 
image captured by the camera portion 220 as a background image. 

(Second Embodiment) 

10 FIG. 5 is a block diagram showing the configuration of an 

image combining portable terminal according to a second embodiment 
of the present invention . In FIG . 5 , the same component components 
as in the first embodiment shown in FIG. 1 bears bear the same 
reference numeral numerals and will not be described again. 

15 In FIG. 5, the image combining portable terminal includes 

an uncombined image recording portion 200, a background image 
acquiring portion 401, a mask recording portion 210, a mask 
information acquiring portion 211, a camera portion 220, a captured 
image acquiring portion 221, an image combining portion 402, a 

20 display portion 240, a recording instructing portion 250 and a 
combined image recording portion 251. 

The background image acquiring portion 401 selects data 
desired by the user from a plurality of recorded images that are 
previously stored in the uncombined image recording portion 200 

25 or selects blank data (totally transparent data) and inputs it 
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to the image combining portion 402 . Here, the data is not limited 
to blank data, but any data, such as image data exclusively used 
to indicate that no combined image is to be used or text data 
indicating that no combined image is to be used, can be used, as 
5 long as it indicates that no combined image is to be used. 

When the image combining portion 4 02 has received image data 
from the background image acquiring portion 401, as in the first 
embodiment, a captured image from the captured image acquiring 
portion 221 is incorporated in a region inside a mask area, combined 

10 with an image from the background image acquiring portion 401 and 
the resultant image is displayed on the display portion 240 . When 
the image combining portion 402 has received an instruction (blank 
data) not to use the image data from the background image acquiring 
portion 401, a captured image from the captured image acquiring 

15 portion 221 is incorporated in a region outside the mask area based 
on the mask information selected by the mask information acquiring 
portion 211 and is displayed on the display portion 240. At this 
time, the image combining portion 402 may display the mask area 
only with a frame line, and also display the captured image within 

20 the mask area. The background image outside the mask area is 
changed as a moving image by moving the camera portion 220. The 
user presses the shutter button of the recording instructing 
portion 250, the moment the mask area is positioned in the optimal 
position in the background image . The image combining portion 402 

25 stores the background image in which the mask area is combined 
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in the uncombined image recording portion 200 in response to the 
shutter instruction from the recording instructing portion 250. 
The image combining portion 4 02 may store the background image 
as it is in the uncombined image recording portion 200 without 
5 combining it with a mask area. 

FIG. 6 shows diagrams for illustrating the operation of the 
image combining portable terminal according to the second 
embodiment. FIG. 7 is a flowchart showing the operation of the 
image combining portable terminal according to the second 

10 embodiment. Hereinafter, the operation of the image combining 
portable terminal will be described with reference to FIGS . 6 and 7 . 
In FIG. 7 , the same step as in the process content shown in FIG. 4 
bears the same step number and will not be described again. 

A recorded image is selected (step S301) , mask information 

15 is selected (step S302), and the area number is initialized 
(step S303) , and thereafter, the image combining portion 402 
determines whether or not an image notified from the background 
image acquiring portion 401 is blank data (step S501) . When it 
is not blank data, the image combining portion 402 performs the 

20 processes of steps S304 to S310 as in the first embodiment. 

On the other hand, in the case of blank data, the image 
combining portion 4 02 incorporates a captured image from the camera 
portion 22 0 outside a selected mask area, and displays the combined 
image as a moving image in the display portion 240 (step S502) . 

25 The frame of the mask area does not have to be displayed with a 
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frame line, but the mask area may be displayed by inverting the 
brightness or other methods that can identify the mask area. 

In the case of blank data, for example, as shown in FIG. 6, 
the image combining portion 402 incorporates a real-time image 
5 from the captured image acquiring portion 221 in a region 10 outside 
a mask area of images shown in FIG. 6A, and displays the captured 
image from the captured image acquiring portion 221 in the real-time 
manner in the region 10 outside the mask area as shown in FIG. 6B. 

Then, the image combining portion 402 fixes the captured 

10 image from the captured image acquiring portion 221 in response 
toa shutter instruction f romthe recording instructingportion 250 
and enters a combined image to be stored (step S503) . This entered 
image may include or may not include the frame displayed in step S502 . 
FIG. 6C shows an example in which the frame is not shown. When 

15 the mask area is displayed by inverting the brightness or other 
methods, either an image that is subjected to this process or an 
image that is not subjected to this process can be used. 

Thereafter, the image combining portion 402 stores the 
combined image that is entered in step S503 in the uncombined image 

20 recording portion 200 (step S504) and ends the process. 

Thus, in the second embodiment, it is possible to select 
blank in the background image acquiring portion 4 01 so that an 
image for display in which a background image and only a mask frame 
are superimposed can be displayed at the time of capturing an image 

25 and stored. Therefore, since an image to be used for background 
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can be previously captured while confirming an area for the captured 
image when using a mask, a background image that allows a face-photo 
portrait or the like to be used as a mask in an optimal position 
can be generated. 
5 In the above second embodiment, when a stored original 

recorded image is used, it is necessary for the user to select 
againmask information, which takes twice as much labor . Therefore, 
in the operation of step S504, the image combining portion 402 
may link the captured background image and the selected mask 

10 information and records record them in uncombined image recording 
portion 200, and may acquire automatically the linked mask 
information at the time of combining images. This can save labor 
for the user to select the mask information. In order to link 
between the background image and the mask information, a management 

15 table for specifying mask information corresponding to the 
background image may be stored in the uncombined image recording 
portion 200, a data identifier that can specify mask information 
may be added to the background image data, or the mask information 
itself may be stored in the uncombined image recording portion 

20 200. 

The linking between the mask information and the background 
image as described above may be performed previously by the third 
party that provides the mask information and/or the background 
image . 

25 
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(Third Embodiment) 

In a third embodiment, an image combining portable terminal 
in which an image stored in the uncombined image recording 
portion 200 may be linked with mask information will be described. 
5 FIG. 1 is referred to for the block diagram for the image combining 
portable terminal. This The third embodiment is different from 
the first embodiment in that the linkage between an image stored 
in the uncombined image recording portion 200 and mask information 
is performed with a management table stored in the uncombined image 

10 recording portion 200 . In the management table, data identifiers 
of mask information corresponding to the images stored in the 
uncombined image recording portion 2 00 are registered. 

FIG. 8 is a flowchart showing the operation of the image 
combining portable terminal according to the third embodiment. 

15 In FIG. 8, the step in which the same operation as in the first 
embodiment is performed bears the same step number and will not 
be described again. 

After a recorded image is selected (step S301), the 
background image acquiring portion 2 01 determines whether or not 

20 there is mask information linked with the selected recorded image, 
referring to the management table stored in the uncombined image 
recording portion 200 (step S601) . When there is no mask 
information linked, the background image acquiring portion 201 
notifies it to the image combining portion 230 (step S602) . 

25 Thereafter, the image combining portion 230 performs the processes 

34 



of step S302 and the subsequent steps in the same manner as in 
the first embodiment. 

On the other hand, when there is mask information linked, 
the background image acquiring portion 201 notifies the data 
5 identifier of the mask information linked with the selected image 
to the image combining portion 230 (step S603) . Then, the image 
combining portion 230 lets the mask information acquiring 
portion 211 select the mask information corresponding to the data 
identifier of the mask information that is notified, acquires the 

10 mask information (step S604), and then performs the processes of 
step S303 and the subsequent steps. 

Thus, in the third embodiment, the recorded image used for 
the background and the mask information are linked, so that the 
optimal mask information to be selected for the background image 

15 is selected automatically, which makes it possible to save labor 
for the user to select the mask information. 

The following embodiment aloo Other embodiments can also be 
conceived. When the designated mask information is not stored 
in the mask recording portion 210, the mask information acquiring 

20 portion 211 lets a communication portion (not shown) acquire the 
mask information from an external device (not shown) via a network 
or the like. 

When the mask information linked with the recorded image 
is deleted from the mask recording portion 210, the mask information 
25 acquiring portion 211 cannot acquire the mask information referring 
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to the data identifier. In order to avoid this situation, the 
image combining portable terminal may store the linked mask 
information separately or may be configured so as to prevent it 
from being deleted or changed. 

5 

(Fourth Embodiment) 

In the fourth embodiment, an image combining portable 
terminal provided with a communication portion is used. The 
configuration of the functional blocks of the image combining 

10 portable terminal according to the fourth embodiment is the same 
as that of the first embodiment, except that a communication portion 
is provided, so that FIG. 1 is referred to. The communication 
portion (not shown) can transmit data obtained by communications 
to the image combining portion 230 or can transmit the data from 

15 the image combining portion 230 to the outside. In the fourth 
embodiment, a final combined image can be created using a plurality 
of image combining portable terminals. Hereinafter, for 
simplification, an example in which a final combined image is 
created by using two image combining portable terminals^ that is, 

20 a first and a second image combining portable terminal is described, 
but as described later, the operation in the case of using three 
or more image combining portable terminals also is evident from 
the following description. 

FIG. 9 is a flowchart showing the operation of the first 

25 image combining portable terminal according to the fourth 
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embodiment. In FIG. 9, the same operation as the operation shown 
in FIG . 4 bears the same step number and will not be described 
again. FIG. 10 is a flowchart showing the operation of the second 
image combining portable terminal according to the fourth 
5 embodiment. FIG. 11 shows diagrams for illustrating the 
operations of the first and the second image combining portable 
terminals according to the fourth embodiment. Hereinafter, the 
operations of the image combining portable terminals according 
to the fourth embodiment will be described with reference to 

10 FIGS. 9, 10 and 11. 

First, when the image combining portion 230 of the first 
image combining portable terminal determines in step S306 that 
there is a remaining mask area, it determines whether or not an 
instruction to transmit an intermediate image generated halfway 

15 to the second image combining portable terminal is supplied from 
the user (step S701) . 

When the instruction to transmit is not supplied, the image 
combining portion 230 proceeds to the operation of step S307, and 
continues to combine images in other mask areas. 

20 On the other hand, when the instruction to transmit is 

supplied, the image combining portion 230 creates intermediate 
information showing the halfway state in image-combining 
(step S702) . Here, the intermediate information includes an 
intermediate image that is combined in the first image combining 

25 portable terminal, information regardingmasks that havebeen used, 
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unused area information showing the area number of a mask area 
in which a captured image is not yet combined. Then, the image 
combining portion 230 lets the communication portion (not shown) 
transmit the intermediate information to the second image combining 
5 portable terminal (step S703) , and ends the process. The image 
combining portion 230 transmits the intermediate information to 
the second image combining portable terminal using electronic mail 
or the like. In this case, the image combining portion 230 can 
convert automatically the intermediate information to electronic 
10 mail format for transmission to the second image combining portable 
terminal . 

Next, referring to FIG. 10, the operation of the second image 
combining portable terminal to which the intermediate information 
is transmitted will be described. In FIG. 10, the same operation 

( 

15 as that shown in FIG. 9 bears the same step number and will not 
be described again. 

First, the image combining portion 230 of the second image 
combining portable terminal receives the intermediate information 
from the first image combining portable terminal via the 

20 communication portion (not shown) (step S801) . When the 
intermediate information is transmitted through electronic mail, 
the second image combining portable terminal preferably starts 
a program for performing the following operations automatically 
or manually from mail software. 

25 Next, the image combining portion 230 identifies the mask 
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area in which a captured image is to be combined, referring to 
the area number designated by the unused area information in the 
intermediate information (step S802) . Next, the image combining 
portion 230 sets the area number of the mask area that is identified 
5 in step S802 to the area number for processing (step S803) and 
goes to the operation of step S304, and continues to combine a 
captured image in the remaining mask area. Also in the second 
image combining portable terminal, thereafter, the intermediate 
information can be transmitted to other image combining portable 

10 terminals such as the first image combining portable terminal 
thereafter in steps S701 to S703. The intermediate information 
can be transmitted one after another to other image combining 
portable terminals in this manner, so that a final combined image 
can be created using at least three image combining portable 

15 terminals. 

When the intermediate information is transmitted from the 
second image combining portable terminal, the first image combining 
portable terminal may continue to combine a captured image in a 
mask area in the same operation as shown in FIG. 10. The final 

20 combined image created by the first and the second image combining 
portable terminals can be exchanged each other using electronic 
mail or the like. In this case, the image combining portable 
terminal may add a header or the like and convert the final combined 
image that is generated automatically to such a format that the 

25 final combined image can be transmitted through electronic mail, 
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and thus transmit it to other image combining portable terminals. 

More specifically, as shown in FIG. 11A, when the first image 
combining portable terminal creates an intermediate image in which 
a captured' image is combined in the mask area 11, it creates 
5 intermediate information including the generated intermediate 
image, information regarding the mask that has been used, and unused 
area information showing that a captured image is not yet combined 
in the mask area 12 by assigning an area number to the mask area 12, 
and thus transmit the intermediate information to the second image 

10 combining portable terminal. 

As shown in FIG. 11B, the second image combining portable 
terminal that has received the intermediate information attaches 
the captured image acquired by itself to the mask area 12 to complete 
the final combined image. Thereafter, the second image combining 

15 portable terminal transmits the combined image to another external 
device such as the first image combining portable terminal. This 
transmission may be performed automatically or based on the 
instruction of the user. 

Thus, in the fourth embodiment, an intermediate image 

20 including information showing an area in which a captured image 
is not yet attached is exchanged among a plurality of portable 
terminals, so that the final combined image can be created by a 
plurality of portable terminals. Thus, a combined image can be 
created by incorporating an image from, for example, a person that 

25 is in a remote location. 



The operation shown in the fourth embodiment can be used 
in the first to the third embodiments. 

In the fourth embodiment, the first image combining portable 
terminal transmits an intermediate image in which a captured image 
5 is attached, but may transmit intermediate information including 
only a background image as the half image, and further including 
mask information and unused area information. In this case, the 
first image combining portable terminal may determine whether or 
not intermediate transmission is performed after step S302 . The 

10 second image combining portable terminal that has received such 
intermediate information combines a captured image in the same 
operation as shown in FIG. 10. In this operation, the second image 
combining portable terminal acquires information in which the 
background image is linked with the mask information through the 

15 communication portion in the same manner. The first image 
combining portable terminal transmits information in which the 
background image is linked with the mask information in the same 
manner 

2 0 INDUSTRIAL APPLICABILITY 

The image combining portable terminal and the method used 
therefor of the present invention allow the area defined by the 
shape, the size, and the position for a combined image to be 
determined with easy operation with simple keys and buttons and 

25 thus are useful in the field of portable terminals and the like. 
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ABSTRACT 

The A n image combining portable terminal combines a recorded 
image prepared in an uncombined image recording portion (200) and 
5 a captured image captured by a camera portion (220) . A plurality 
of sets of mask information defining at least one area in which 
the captured image is to be combined with the recorded image are 
stored in a mask recording portion (210) . The mask information 
acquiring portion (211) selects desired mask information from the 
10 mask recording portion (210) in response to an instruction of a 
user. The image combining portion (230) combines the recorded 
image and the captured image in an area designated by the mask 
information selected by the mask information acquiring 
portion — (211) . 



42 



